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We show that memristive networks-namely networks of resistors with memory-can efficiently solve 
shortest-path optimization problems. Indeed, the presence of memory (time non-locality) promotes 
self organization of the network into the shortest possible path(s). We introduce a network entropy 
function to characterize the self-organized evolution, show the solution of the shortest-path problem 
and demonstrate the healing property of the solution path. Finally, we provide an algorithm to 
solve the traveling salesman problem. Similar considerations apply to networks of memcapacitors 
and meminductors, and networks with memory in various dimensions. 
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I. INTRODUCTION 



Currently, much attention is being devoted to memory 
circuit elements (memelements) [lj [2] and their applica- 
tions in different domains of electronics [3]- In particu- 
lar, computing with memelements [H[S] - memcomputing 
- has received much attention because of the ability of 
network architectures built out of memelements to store 
and process information on the same physical platform 
[3HB]. This is a major conceptual and practical depar- 
ture from the present day architectures based on the von 
Neumann machine concept [7]. The strength of mem- 
computing is essentially based on the analog massively- 
parallel dynamics of many-if not all-memelements in the 
network and the ability to recover the result (s) of the 
computation from the same computing units, much like 
the brain is thought to operate [SJ [5] . Examples of ap- 
proaches to compute with memelements include neuro- 
morphic computing with memristive synapses [U EHE] , 
massively-parallel computing with memristive networks 
[5j Q~5] , logic with memory circuit elements |H |H1 HS1 EZ] > 
and memristive cellular automata [18] . 

In order to realize this memcomputing paradigm some 
criteria need to be satisfied. We have introduced and 
expended on these criteria in Ref. [S]. These are 

1. Scalable massively-parallel architecture with com- 
bined information processing and storage. 

2. Sufficiently long information storage times. 

3. The ability to initialize memory states. 

4. Mechanism(s) of collective dynamics, strong "mem- 
ory content". 

5. The ability to read the final result (from relevant 
memelements) . 



6. Robustness against small imperfections and noise. 

One can show that the memcomputing schemes men- 
tioned above satisfy all or the majority of these crite- 
ria. [5] We also note that although memristive devices 
|19j are the main focus of present efforts, memcapacitive 
and meminductive devices pQ are also of great promise 
because of their potential to perform calculations at a 
minimal energy cost. 

Previously, we demonstrated a maze problem solu- 
tion using memristive networks [5]. Clearly, all of the 
above requirements are satisfied within this approach 5J . 
In this paper we consider a more complex case of the 
shortest-path optimization - the shortest path optimiza- 
tion on a two-dimensional plane. In fact, our approach 
and results can be easily extended to any hyperplane in 
an TV-dimensional space, with N > 1. The difficulty 
inherent in this problem stems from the fact that any 
two points of the plane are connected by multiple often 
degenerate paths, which complicates the finding of sin- 
gle optimal solution. We show that random networks 
-without any predefined symmetry directions- are more 
promising in this regard. In addition, we suggest an al- 
gorithm that provides a possible solution to the NP-hard 
traveling salesman problem. A further development of 
the suggested algorithm may lead to some quite inter- 
esting results on the long way [20] toward finding more 
efficient solutions of this problem. 

The paper is organized as follows. In Sec. [TTJ we dis- 
cuss essential details of memcomputing schemes utiliz- 
ing memristive networks. Sec. |III| presents our studies 
of memcomputing with symmetric (regular) networks. 
In particular, we show that regular networks can find 
a unique solution if a pair of specified nodes is located 
along a symmetry direction. In a more general case, how- 
ever, a doubly degenerate solution is obtained. Moreover, 
we demonstrate the healing property of the solution path 
(Sec. Ill C). Sec. IV studies memcomputing with random 
networks suitable to solve the shortest-path problem in 
any direction (Sec. |IV A). We also suggest an algorithm 
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that provides an approximate solution to the traveling 
salesman problem (Sec. IV B). Finally, in Sec. [Vlwe give 




FIG. 1: An example of memristive processor consisting of 
a network of memristive elements in which each grid point 
is attached to several basic units. Each basic unit involves 
two memristive devices connected symmetrically (in-parallel) 
and two switches (field-effect transistors). The switches pro- 
vide access to individual memristive devices, while in-parallel 
connection symmetrizes the response of bipolar memristive 
elements. 



our conclusions. 



B. Algorithms 

Computation algorithms for memristive processors in- 
volve three standard stages: initialization, calculation 
and result reading. In this work, we focus on solving 
the shortest path and traveling salesman problems. The 
corresponding algorithms arc formulated below. 



1. The shortest-path problem 

In the shortest-path problem, we want to find the 
shortest path between two specified (input and output) 
nodes (such as, for example, those shown by red arrows 
in Fig. [21(a) or (b)) in the network. The algorithm used 
for this calculation is the following: 

Initialization stage: all memristive devices are pre- 
initialized into the "OFF" (high-resistance) state. 

Calculation stage: a voltage pulse of a suitable am- 
plitude and duration is applied to the pair of specified 
nodes. 

Calculation reading: the shortest path is given by a 
sub-set of basic units in their "ON" (low-resistance) state 

EH- 



2. Traveling salesman problem 



II. MEMCOMPUTING WITH MEMRISTIVE 
NETWORKS 



Memristive Processor 



A memristive processor (network) consists of a collec- 
tion of grid points on an hyperplanc of A^-dimcnsional 
space {N > 1) connected by basic units involving memris- 
tive elements and traditional elements, such as switches 
(see Fig. fll). Below, we consider different organizations 
of the grid points including a regular square array such 
as that shown in Fig. [I] and a random one on a 2D plane. 
Although not strictly necessary, in the examples we have 
chosen the design of each basic unit to be symmetric (in- 
volving two bipolar memristive elements) so as to con- 
veniently provide independency of the circuit operation 
on the sign of the applied voltage. We also introduce 
switches for two main functions: i) to provide indepen- 
dent access to each individual memristive device, and ii) 
to define the network topology, if needed (see Ref. \E\ for 
an example). Thus, the architecture of Fig. fl] provides 
access to each individual memristive device for the pur- 
pose of initialization and reading of the calculation result. 
The calculation consists in the evolution of the network 
state-defined as the collection of states of all memristive 
devices-when an appropriate pulse sequence is applied to 
a sub-set of grid points. 



In the traveling salesman problem [2T], a salesman is 
given a set of cities to visit. The objective of the salesman 
is to find a path which minimizes the round-trip distance 
-each of the cities should be visited only once. In order 
to solve this problem, we will consider a two-dimensional 
memristive network and select a set of nodes representing 
all the cities in the set. The actual geographic locations 
of the cities will be taken into account for the selection 
of nodes. The basic algorithm for the traveling salesman 
problem includes the following steps: 

Initialization stage: all memristive devices are pre- 
initialized into the "OFF" (high-resistance) state. 

Calculation stage: a sequence of square voltage pulses 
of random polarity is applied to randomly selected pairs 
of nodes representing the cities. During this stage, low- 
resist ancc paths in the network will start to develop. Im- 
portantly, the memristive network will retain memory on 
the previously applied pulses, and the subsequent net- 
work evolution will be largely based on the topology of 
the already developed low-memristance paths. In this 
way, an optimized problem solution emerges. Moreover, 
we anticipate that the path formation in the network oc- 
curs hierarchically: at shorter times, the low memristance 
paths between closely spaced cities are formed, and, at 
longer times, these different group of cities become con- 
nected. As the electric current tends to flow through the 
shortest /least resistive path, we expect that the proposed 
algorithm works out the traveling salesman problem, at 
least in some cases. 
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FIG. 2: (Color online). Solution of the shortest path problem for the pair of nodes indicated by red arrows in (a) and (b) 
in a an 11x11 memristive network, (a) Initial and (b) final states of the memristive network. Here, the memristance of each 
basic unit (involving two memristive devices) is represented by a color. The vertical red (dashed) line shows the network 
cross-section used in entropy calculations. Distributions of electron current corresponding to (a) and (b) are shown in (c) and 
(d), respectively. See Methods for details of all calculations. 



Calculation reading: the shortest path is given by a 
sub-set of basic units in their "ON" (low-resistance) state. 



III. SELF-ORGANIZATION AND HEALING IN 
REGULAR NETWORKS 

A. Self-organization 

We now provide an explicit example of computing 
with memelements - specifically with regular memristive 
networks - in order to exemplify even further the cri- 
teria given above, and the possibilities offered by this 
paradigm. Details of the specific memristive systems 
used and the simulation details can be found in Appendix 
A. 

Fig. [2]Ja) shows the initial state of the network when 
all memristive devices are in their "OFF" states. At the 
initial moment of time t — 0, a single constant ampli- 
tude voltage pulse is applied to the input/output nodes 
shown by red arrows in Fig. [5Ja). The final state of the 



memristive network (the calculation result) is presented 
in Fig. [21(b) . Clearly, two specified nodes are connected 
by a chain of memristive devices in the "ON" state giving 
the shortest path problem solution. Note that Fig. [2Va), 
(b) depict the memristance of each basic unit consisting 
of two memristive devices. 

Let us now consider the network evolution - the dy- 
namics of the calculation stage - in more details. First 
of all, we would like to mention a similarity between 
the process of computing as performed by the memris- 
tive processor and the ant-colony optimization algorithm 
[221 125] . The latter is an adaptable algorithm inspired by 
the observation that ants, upon finding food, mark their 
trails by pheromones thus attracting other ants in order 
to reinforce the trail closest to their nest. A similar type 
of reinforcement is observed in the memristive network 
dynamics. Fig. [2|c) shows the current distribution in 
the network at the initial moment of time when all the 
memristive devices are in the "OFF" state. In this case, 
the current flows in multiple paths. However, since the 
rate of memristance change is proportional to the current, 
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FIG. 3: (a) Dynamics of resistance switching within the 
calculation stage corresponding to the shortest-path problem 
solution presented in Fig. [2] This plot shows that the solu- 
tion emerges from both sides and propagates to the center, 
(b) Network entropy as a function of time from Eq. |T]) for 
networks of different memory content. A slight increase of the 
entropy for the R^t c / 'Ro„ = 10 curve at the time of about 0.4 
(arb. units) is due to a delayed switching of four vertical units 
directly connected to the input/output nodes. 
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FIG. 4: (Color online). Solution of the shortest-path problem 
by a network of low memory content, R^ff/R^i, — 1.25. 
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FIG. 5: (Color online). Solution of the shortest-path problem 
by a network of high memory content, R^jf/RoL = 10, when 
the input and output nodes (shown by arrows) are selected 
not along a symmetry direction. Two possible solutions are 
found. 



the memristance of the least resistive path will decrease 
faster "attracting" more and more current. Therefore, 
the current flowing through the least resistive path will 
reinforce this path, similarly to the trail reinforcement of 
the ant colony, see Fig. [2|d). 

Moreover, it is interesting to note that the problem 
solution develops gradually, starting from both the speci- 
fied nodes. This is clearly seen in Fig. [3|a) that presents 
the rate of change of the memristances along the solution 
path as a function of time. Note also that the reinforce- 
ment of the solution is not supervised, thus implying that 
the shortest path arises spontaneously as a self-organized 
process. This is an important fundamental result: it is 
the presence of memory-namely time non-locality-in the 
system that leads to self-organization of the dynamics: 
no memory, no self-organization. 



B. Network entropy 

In order to quantify the system evolution even further, 
we define a network entropy with respect to currents in 
the network (similarly, we can use memristances for this 
purpose). For example, by considering currents through a 
vertical cross section of the network at its center (see Fig. 
K2[b)), we can define the network cross section entropy as 



N-l 



<Ti(t) 



^4(t)in(4(t)), 



(i) 



3=0 



where N is the number of basic units connected in the 
horizontal direction (crossed by the red (dashed) line in 
Fig. [2lb)), j is the index of the row of horizontal basic 



units crossed by the cross-section, Jy = Iij/hot is the 
normalized current through a horizontally connected ba- 
sic unit, and Itot = Ylj=o Ar Fig- PP 5 ) demonstrates 
(with N = 11 and i = 6) that the network entropy de- 
creases in time as the computation proceeds. In statisti- 
cal physics, the entropy is related to the number of states 
available to the system. Here, its decrease can be thus in- 
terpreted as due to the decrease in the number of paths 
available for the current, with a more pronounced de- 
crease the larger the memory content in the system (as 
represented by the ratio R ff/R on ). Alternatively, one 
can consider an entropy defined for the complete net- 
work, namely, a(t) = — J^. Jy (t)ln ( Jy (t) ) , where the 
summation is performed over all edges in the network. 
Qualitatively, its time dependence is expected to be close 
to that shown in Fig. [3^b) for the cross section entropy. 
In order to show that networks with higher memory 
content provides a better solution, we perform a calcula- 
tion similar to that presented in Fig. [2] assuming, how- 
ever, a much smaller difference between R^ and R^l f of 

JRf n = 1.25 compared to 



each memristive device {R^ftt 



R off 



/Ron = 20 used in the previous calculation). Fig. H 
demonstrates that now the solution of the shortest-patn 
problem can not be found exactly at the given bias. In 
fact, in addition to the switching of memristive devices 
directly connecting the input and output nodes, many 
other memristive devices are also switched into the "ON" 
state (see Fig. El. This example demonstrates the impor- 
tance of the strong "memory content" requirement (cri- 
terion 4 discussed in the Introduction, see also Ref. [5]). 

In the general case, however, when the selected nodes 
are located along an arbitrary direction (different from 
the network symmetry directions), regular networks fail 
to uniquely find the problem solution. We demonstrate 
this feature in Fig. [5] showing a shortest-path prob- 
lem solution, which is doubly degenerate and developed 
along the symmetry directions of the network. This is 
a direct consequence of the network symmetry. Conse- 
quently, we expect that networks without any local or 
global symmetry-random networks-or ordered networks 
but not periodic-such as quasi-periodic networks |24|- 
are best candidates to solve shortest-path optimization 
problems on the hyperplane. In Sec. |IV| below we indeed 
show that random networks can find the proper solution 
for arbitrary oriented selected nodes. 



C. Healing of the damaged solution 

In order to analyze criterion 6 discussed in the Intro- 
duction in more detail, let us now damage the shortest- 
path problem solution shown in Fig. WCb) (as well as 
the network) by removing three horizontal basic units in 
the central part of the network as shown in Fig. [6[a). 
We note that, due to memory, the memristive network 
has a remarkable ability to repair damaged solutions-the 
healing ability we have mentioned above. Indeed, this 
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FIG. 6: (Color online). Healing (b) of a damaged (a) solu- 
tion. To heal the solution damage in (a), a single square pulse 
of appropriate width and duration is applied to the input and 
output nodes shown by the red arrows in (b). 



property is close to the self-healing ability that can be 
ascribed to systems or processes, which by nature or by 
design tend to correct any disturbances. 

The healing of the damaged solution is performed by 
applying a single pulse of a certain amplitude and du- 
ration to the input and output nodes. The result pre- 
sented in Fig. |6jb) shows that a new path connecting 
two pieces of the initial shortest-path solution develops 
below the damaged region. The three missing connec- 
tions have been removed intentionally in an asymmetric 
fashion in order to show that the healing occurs along 
the shortest possible path around the damaged region. 

It is easy to understand the origin of this healing pro- 
cess: as soon as we switch on the pulse between the input 
and the output nodes, the current will flow through all 
possible paths. However, the shortest one is again the 
one that is mostly affected, and thus reinforced during 
dynamics. 

The stability of the shortest-path problem solution to 
small imperfections of the system (e.g., finite width dis- 
tributions of threshold current, limiting values of mem- 
ristance, etc.) is evident, and therefore does not deserve 



a closer inspection. 



IV. RANDOM NETWORKS 

Let us now discuss the use of networks with no lo- 
cal/global symmetry in the solution of optimization prob- 
lems. Such random networks are generated using the fol- 
lowing algorithm. The nodes are placed randomly in a 
Na x Na square area where N is a number and a is a 
unit length with the constraint that no two nodes can 
be closer than 0.9a. After that, any two nodes located 
closer than 1.5a are connected by a memristive edge. We 
note that the random networks obtained in this way may 
involve some local intersections of edges that do not play 
any significant role in the network dynamics, but in prin- 
ciple could be realized on a chip. Therefore, we do not 
bother with resolving the crossings. Moreover, we assume 
that each edge is of a similar structure to that shown in 
Fig. [I] and, on the hardware level, all operations such as 
initialization, dynamics, and reading of the final results 
are performed as described in Sec. [TTJ Therefore, the only 
difference between regular and random networks is in the 
network topology. 
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A. The shortest-path problem 

Fig. [7] shows solutions of the shortest-path problem 
found with random networks for two different choices of 
specified nodes. In both cases, the solution is very close 
to the shortest geometrical solution. However, in some 
cases, small deviations from the shortest solution are pos- 
sible such as a small 'bump' in Fig. fflb) starting at the 
second node of the solution path bypassing an area of 
closely-spaced nodes (follow the solution path from the 
left bottom specified node) . We associate such deviations 
with local inevitable fluctuations of network resistivity. 
As, initially, each edge in the network is of the same re- 
sistance, longer edges are more likely to be involved in the 
solution path as they offer less resistance to the current 
flow. 

Clearly, a solution degeneracy or near-degeneracy is 
also possible with random networks. For example, Fig. 
bla) demonstrates a solution splitting in its central part. 
In some cases, the solution near-degeneracy (for exam- 
ple, 2 parallel segments of different length) can be re- 
moved by a post-processing procedure in which the first 
problem solution (the set of edges in the R on state) is 
used as a new network for the shortest-path problem 
that is subsequently solved following exactly the same 
algorithm as outlined in Sec. |HB 1| Additionally, such 
post-processing procedure (that actually can be applied 
several times) removes all possible 'dead ends' as well as 
segments disconnected from the solution path that occa- 
sionally are switched into R on state (an example of 'dead 
end' is the edge to above the left specified node in Fig. 
0a)). 



FIG. 7: (Color online). Solution of the shortest-path prob- 
lem by a random 20a x 20a network for a horizontal (a) and 
diagonal (b) choice of the specified nodes (large yellow circles) . 
These solutions are obtained for R^jj/R^ = 100. 



B. Traveling salesman problem 

Let us now consider the traveling salesman problem. 
For this purpose we use the algorithm described in Sec. 
|HB2| and we apply it twice. First of all, we apply this 
algorithm to the original network (Fig. [8|a)) and find the 
solution (that we call as the initial solution SI) presented 
in Fig. ISFb). This solution, however, contains some dis- 
connected edges in the R on states and 'dead ends' (paths 
with single connection). In order to improve on the initial 
solution, we use a post-processing procedure consisting 
in the following. We form a reduced network consisting 
of all edges of SI that are in the R on state and nodes 
connected by these edges. Then, the traveling salesmen 
algorithm (Sec. II B 2 1 is applied to the reduced network. 



The total number of post-processing operations depends 
on the network complexity. Networks presented in this 
paper normally require 1-2 operations of this type. The 
final solution is represented in Fig. [s](c) by edges in R on 
state (connected by red lines in the same figure). This 
is the correct solution of the traveling salesman problem 
for the given configuration of cities. 

Currently, however, it is difficult to identify strict 
mathematical conditions when the traveling salesman 
problem can be correctly solved by our approach and 
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FIG. 8: (Color online). Solving the traveling salesman prob- 
lem using a random 40a x 40a network: (a) initial state 
of the network with cities denoted by large yellow circles, 
(b) initial solution, (c) improved solution (red lines) after 
post-processing where the 'dead ends' (grey lines) have been 
eliminated. This solution is obtained for a network with 



Roff/R 



100. The final solution of the traveling sales- 



man problem is represented by edges in R on state in (c). 



networks. Such approach is related to the concept of 
memcomputing: storing and processing of information on 
the same physical platform [5]. There are six main cri- 
teria that need to be satisfied in order to realize such a 
paradigm and it is clear that memristive networks con- 
sidered in this paper satisfy all of them. Unlike other 
promising but more speculative proposals, like quantum 
computing, memcomputing is already a practical reality, 
at least in regard to some applications, such as digital 
logic. It bypasses several of the bottlenecks of present- 
day computing architectures and its constitutive units- 
memristors, memcapacitors, and meminductors-are al- 
ready widely available. Indeed, these elements emerge 
quite naturally with increasing miniaturization of elec- 
tronic devices. The computational possibilities offered by 
this paradigm are varied, and due to its tantalizing sim- 
ilarities both with some features of the brain as well as 
with the collective properties of colonies of living organ- 
isms, it promises to open new directions in neuromorphic 
architectures and biological studies. 

In this work we have suggested and studied the im- 
plementation of the shortest-path and traveling salesmen 
problem algorithms utilizing memristive networks. The 
main advantage of our approach is based on the analog 
parallel dynamics of many memristive devices. We have 
reported certain limitations of periodic networks that in 
some cases provide degenerate solutions. Random and 
quasi-periodic networks without any (or a few) symme- 
tries are more promising in this regard. We have con- 
sidered the network evolution that can be conveniently 
described by a network entropy. We anticipate that net- 
works with memory have a wide range of applications 
beyond the shortest-path problems. In particular, such 
networks can be used to simulate problem solving abili- 
ties of the human brain, the effect and progress of mental 
illness, etc. 
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when it can not be solved. But, even in the cases when 
the complete solution can not be found, it is quite pos- 
sible that the suggested algorithm will provide partial 
solutions and thus tremendously reduce the number of 
possibilities to verify. Understanding these limitations 
will be subject of a future study. 



Appendix A: Simulations 

The numerical results presented in this paper have 
been obtained for a network of current-controlled bipo- 
lar memristive devices with threshold. Each memristive 
device is described by 



CONCLUSION 



and 



V M = R(x)I M , 



(Al) 



In conclusion, we have studied the possibility to solve 
shortest-path optimization problems with memristive 



da; 


( 




for \I M \< It (A2) 


di = 


\ sgn(/ M ) i{\Im\ ■ 


-It) 


for \I M \> It (A3) 



where Vm and Im = q(t) denote the (time-dependent) 
voltage and current across the device, respectively, 
R(x) = x is the memristance that changes between two 

is the internal state vari- 






limiting values i?*„ and R 

able, 7 is a constant describing the rate of change of mem- 
ristance when the magnitude of the electric current Im 
exceeds the threshold current I t ; and sgn is the sign func- 
tion. We note that a current-controlled threshold-type 
memristive device model was used to describe switching 
in bipolar memristive devices [25] . Moreover, many mod- 
els of voltage-controlled memristive devices can be eas- 
ily reformulated in the current-controlled form [3J. Eqs. 
(Al)- (A3) was directly used in our studies of the short- 



est path problem. In the case of the traveling salesman 
problem, an absolute value of voltage was applied to each 
basic unit (edge) in order to avoid back-and-forth switch- 
ings when random polarity voltage is applied. Such an 
approach can be easily implemented in electronics. 
All numerical results were obtained for the follow- 



ing model parameters: 



r>M 

R off 



0) = R$ f , 7 = 10 6 Ohms/(s-A), I t = 10mA. Figs, g 
p[a), p3J and kh are obtained with R^ n = 10 Ohms and 

V = 6V of applied voltage; Fig. [3Tb) is found using 

V = 6,6.75,10,15.25V for RM ff /R™ = 20,10,4,1.25 
curves, respectively; Fig. [I] is plotted with R^ n = 160 
Ohms and V = 15.25V. Note that R™ and Rf ff are 
related to individual memristive devices, while R on and 
Roff (used in figures) represent limiting values of mem- 
ristance of the basic unit. While the "OFF" state of the 
basic unit is attained when both memristive devices are 
in their "OFF" states, the "ON" state of the basic unit 
corresponds to the "ON", "OFF" combination of single 
device states. In our simulations, at each time step, the 
potential at all grid points is found as a solution of Kirch- 
hoff 's current law equations obtained using a sparse ma- 
trix technique. The corresponding change in the mem- 
ristive states was computed using Eq. (A3). The width 



= 200 Ohms, Rij(t 



of the voltage pulse is selected sufficiently long to reach 
the steady state in each calculation. 
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